Skip to content

[Refactor] to simplify and extract the shared logic between chat completion and responses#27961

Merged
chaunceyjiang merged 8 commits intovllm-project:mainfrom
chaunceyjiang:tool_call_refactor
Nov 5, 2025
Merged

[Refactor] to simplify and extract the shared logic between chat completion and responses#27961
chaunceyjiang merged 8 commits intovllm-project:mainfrom
chaunceyjiang:tool_call_refactor

Conversation

@chaunceyjiang
Copy link
Copy Markdown
Collaborator

@chaunceyjiang chaunceyjiang commented Nov 3, 2025

Purpose

[Refactor] to simplify and extract the shared logic between chat completion and responses

fix #26874 (comment)

Test Plan

see e2e

Test Result


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

@mergify mergify Bot added the frontend label Nov 3, 2025
@chaunceyjiang chaunceyjiang marked this pull request as ready for review November 3, 2025 06:22
@chaunceyjiang chaunceyjiang added the ready ONLY add when PR is ready to merge/full CI is needed label Nov 3, 2025
Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread vllm/entrypoints/openai/serving_engine.py Outdated
@mergify mergify Bot added the tool-calling label Nov 3, 2025
@chaunceyjiang chaunceyjiang force-pushed the tool_call_refactor branch 2 times, most recently from c46a8c8 to 66d796b Compare November 4, 2025 03:17
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
…letion and responses

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
@chaunceyjiang
Copy link
Copy Markdown
Collaborator Author

/cc @aarnphm PTAL.

@chaunceyjiang chaunceyjiang merged commit 0976711 into vllm-project:main Nov 5, 2025
48 checks passed
ZhengHongming888 pushed a commit to ZhengHongming888/vllm that referenced this pull request Nov 8, 2025
…letion and responses (vllm-project#27961)

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
devpatelio pushed a commit to SumanthRH/vllm that referenced this pull request Nov 29, 2025
…letion and responses (vllm-project#27961)

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

frontend ready ONLY add when PR is ready to merge/full CI is needed tool-calling

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants